APPARATUS AND METHODS FOR INSERTING 
AND DETECTING ELECTRONIC WATERMARK 



[0001] 

5 FIELD OF THE INVENTION 

This invention relates to an electronicwatermark inserter, 
an electronic watermark detector, generally, an electronic 
watermark system, and methods for inserting and detecting the 
electronic watermark employing the inserter and the detector. 
10 More particularly, it relates to a method for preventing the 
electronic watermark inserted into a picture or image, termed 
herein as "picture" collectively, from being decoded. 
[0002] 

BACKGROUND OF THE INVENTION 
15 Up to now, i n cop i ng wi th rap i d I y i ncreas i ng ut i I i zat i on of 

an electronic medium, such as picture, image or multimedia, an 
electronic watermark is embedded electronically into a picture 
or image for facilitating discrimination of a data source. 
[0003] 

20 The furnisher of the electronic medium embeds electronic 

watermark signals for identifying the furnisher in the data of 
the electronic medium it supplies. As the electronic watermark 
signals are detected by the software or the hardware, the 
furnisher proves that is an owner of the copyright for 

25 supervising and managing the copyright. 
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[0004] 

The above-described method for inserting and extracting 
the aforementioned electronic watermark is disclosed in, for 
example, the JP Patent Kokai JP-A-1 0-1 45757 or JP Patent Kokai 
5 JP-A-10-191330. 
[0005] 

SUMMARY OF THE DISCLOSURE 

However, there is much to be desired in the conventional 

art. 

10 The above-described conventional method for inserting the 

electronic watermark suffers a drawback that, if the parameters 
used in inserting the electronic watermark into the picture or 
the image are decoded, the electronic watermark inserted into 
the picture or the image may be decoded readily. 

15 [0006] 

It is therefore an object of the present invention to 
eliminate the above drawback and to provide an electronic 
watermark inserter and an electronic watermark detector which 
render it possible to improve the secrecy of the electronic 
20 watermark inserted and methods for inserting and detecting the 
electronic watermark used in the electronic watermark inserter 
and detector. 
[0007] 

According to an aspect of the present invention, there is 
25 provided an electronic watermark inserter for inserting an 
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electronic watermark pattern or patterns for identifying a 
furnisher of a picture or image (termed "picture" collectively, 
herein after) into data of the picture, in which the inserter 
comprises: an electronic watermark pattern inserter for 
5 inserting previously generated key information pattern or 
patterns into a picture or pictures into which the electronic 
watermark pattern or patterns have been inserted and for 
transmitting the resulting picture or pictures. 
[0008] 

10 According to a second aspect of the present invention, 

there is provided an electronic watermark detector for detecting 
an electronic watermark pattern or patterns for specifying a 
furnisher for a picture inserted into data of the picture, in 
which the detector comprises: 

15 means for detecting a key information pattern or patterns 

inserted into the data of the picture along with an electronic 
watermark pattern or patterns, means for generating parameters 
required for detecting the electronic watermark pattern or 
patterns from the key information as detected, and means for 

20 detecting the electronic watermark pattern or patterns from the 
picture based on the parameters generated in the parameter 
generating means. 
[0009] 

According to the third aspect of the present invention, 
25 there Is also provided a method for inserting an electronic 



watermark pattern or patterns for identifying a furnisher of a 
picture or pictures into data of the picture(s), in which the 
method includes a step of: providing a key information pattern or 
patterns, a step of inserting previously provided key 
i nformat i on pattern or pat terns i nto a p i cture or p 1 ctures, into 
which an electronic watermark pattern or patterns have been 
inserted, and a step of transmitting the resulting picture or 
pictures. 
[0010] 

According to a fourth aspect of the present invention, 
there is further provided a method for detecting an electronic 
watermark pattern for specifying a furnisher for a picture 
inserted into data of the picture, In which the method includes 
a step of detecting key information pattern or patterns 
inserted into the data of the picture or pictures along with the 
electronic watermark pattern or patterns, a step of generating 
parameters required for detecting the electronic watermark 
pattern or patterns from the key information pattern or patterns 
as detected, and a step of detecting the electronic watermark 
pattern or patterns from the picture or pictures based on the 
parameters generated. 

According to a fifth aspect, there is provided an 
electronic watermark system comprising the electronic watermark 
inserter and detector according to the foregoing aspects. 
[0011] 
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Thus, the electronic watermark inserter of the present 
invention inserts the key information patterns at random 
coordinates centered about a preset interval into a picture(s) 
having an electronic watermark pattern (s) Inserted therein. 
5 [0012] 

On the other hand, the electronic watermark detector of the 
present Invention verifies the key inforniation pattern(s), 
inserted along with the electronic watermark pattern{s), to 
generate the electronic watermark pattern (s) from the result of 
10 the decision. 
[0013] 

Since this restores the secret key, inserted alongwith the 
electronic watermark pattern(s), the ciphered electronic 
watermark pattern{s) can be detected to detect the ciphered 
15 information inserted in the picturels). 
BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the structure of an 
electronic watermark inserter according to an embodiment of the 
present invention. 
20 Fig. 2 shows exemplary key information patterns used in the 

preferred embodiment of the present invention. 

F i g. 3 is a block diagram showing the structure of an 
electronic watermark detector according to an embodiment of the 
present invention. 
25 Fig. 4 isa isablockdiagramshowingthestructureofakey 



detector of Fig. 3. 

Fig. 5 is a flowchart for illustrating the processing 
operation of the electronic watermark inserter shown in Fig. 1. 

Fig-6 is a flowchart for Illustrating the processing 
operation of an electronic watermark inserter shown in Fig. 3. 

Fig. 7 is a flowchart for illustrating the processing 
operation of the key detector shown in F i g. 4. 
[0014] 

PREFERRED EMBODIMENTS OF THE INVENTION 

Referring to the drawings, certain preferred embodiments 
of the present invention are explained in detail. F i g. 1 is a 
block diagram showing the structure of an electronic watermark 
inserter. In Fig. 1, the electronic watermark inserter 
according to the preferred embodiment of the present invention 
is made up of an electronic watermark pattern inserter 1, a key 
information pattern inserter 2, a picture analyzer 3, an 
electronic watermark pattern storage unit 4 and a key 
information pattern storage unit 5. 
[0015] 

The picture analyzer 3 analyzes an input picture (or image) 
101, such as MPEG (Moving Picture Experts Group) data, decides 
the insertion strength of the electronic watermark to be 
inserted, from one pixel to another of the input picture 101 to 
another, to output the insertion strength info r mat ion 104 to the 
electronic watermark pattern inserter 1 and to the key 
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information pattern inserter 2. 
[0016] 

The electronic watermark pattern inserter 1 inserts an 
electronic watermark pattern 105, stored in the electronic 
5 watermark pattern storage unit 4, into the input picture 101, in 
accordance with the insertion strength information 104 from the 
picture analyzer 3, and outputs a picture to be processed 102, 
into which has been inserted the electronic watermark pattern, 
to the key information pattern inserter 2. 
10 [0017] 

The key information pattern inserter 2 inserts key 
information patterns 106, stored in the key information pattern 
storage un i t 5, i nto the p i cture to be processed 1 02, into which 
the electronic watermark pattern has been inserted by the 

15 electronic watermark pattern inserter 1, in accordance with the 
insertion strength information 104 from the picture analyzer 3, 
to output a resultant picture processed 103, into which has been 
inserted the key information pattern, to outside. Meanwhile, 
the key information pattern inserter 2 inserts the key 

20 information pattern as the patterns each shifted in a random 
direction, respectively. 
[0018] 

Fig. 2 shows exemplary key information patterns used in an 
embodiment of the present invention. In Fig. 2, a number of key 
25 information patterns (i. e. , reference or prototype original key 
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patterns) are arranged at a present interval, as indicated by 
solid-line blocks in Fig. 2. The respective patterns are 
shifted in respective random directions, when the key 
information patterns are inserted by the key information pattern 
5 inserter 2 into the picture to be processed 102, into which has 
been inserted the electronic watermark patterns, as indicated by 
broken line blocks shown in Fig. 2. 
[0019] 

F i g. 3 shows a block diagram showing the structure of the 
10 electronic watermark detector according to an embodiment of the 
present invent ion. lnFig.3, the e I ect ron i c watermark detector 
according to the instant embodiment of the present invention is 
made up of a key detector 6, a cipher decoder 7 and an electronic 
watermark detector 8. 
15 [00201 

The key detector 6 detects the key information, inserted 
fol lowing the insert ion of the electronic watermark pattern (s), 
from an input picture 201, to output the key information 202 
detected, and the input picture 201, to the cipher decoder 7. In 
20 this case, the key detector 6 outputs the input picture 201 
straightforwardly to the cipher decoder 7. 
[0021] 

The cipher decoder 7 generates parameters required by the 
electronic watermark detector 8, based on the input picture 201 
25 and the key information 202, to output the so-generated 
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parameters and the input picture 201 to the electronic watermark 
detectors. In this case, the c i pher decoder 7 outputs the i nput 
picture 201 straightforwardly to the electronic watermark 
detector 8. 
5 [0022] 

The electronic watermark detector 8 detects the electronic 
watermark patterns, inserted into the Input picture 201, based 
on the parameters 203, which are required for electronic 
watermark detection, and which are generated by the cipher 
10 decoder 7, to output detected results 204 to outside. 
[0023] 

F 1 g. 4 Is a block diagram showing the structure of the key 
detector 6. In F i g. 4, the key detector 6 is made up of a block 
sheer 61, an inner product unit 62, a maximum inner product 
15 value decision unit 63, a search range end decision unit 64, a 
key information generator 65, a coordinate calculating unit 66, 
a key information pattern storage unit 67 and a maximum inner 
product buffering unit 68. 
[0024] 

20 The block slicer 61 slices one block 301 of the input 

picture 201, with a coordinate 307 obtained by the coordinate 
calculating unit 66, to output the so-sliced block 301 to the 
inner product unit 62. The inner product unit 62 finds an inner 
product of the sliced block 301 from the block slicer 61 and the 

25 key information pattern stored in the key information pattern 
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storage unit 67 to output a result of the inner product 302 to the 

maximum inner product value decision unit 63. 

[0025] 

The maximum Inner product value detection unit 63 compares 
5 the result of the inner product 302 from the Inner product unit 
62 to the information 311 in the maximum inner product buffering 
unit 68. If the result shows that the inner product 302 is 
larger, the maximum inner product value detection unit 63 
outputs the result of the inner product 302 and a coordinate 307 

10 obtained from the coordinate calculating unit 66, that is the 
coordinate of the sliced-out block, to the search range end 
decision unit 64, as a decision result 303, while substituting a 
result of the inner product 304 for a corresponding value of the 
maximum inner product buffer in the maximum inner product 

15 buffering unit 68. It should be noted that the maximum inner 
product buffering unit 68 is made up of a number of maximum inner 
product value buffers #1 to #n corresponding to the number of key 
information pattern insertion positions (see Fig. 2). 
[0026] 

20 When fed with an end signal 309 indicating the end of the 

block slicing of a preset range from the coordinate calculating 
unit 66, the search range end decision unit 64 outputs an end 
signal 305 to an enlargement/contraction rate decision unit 65. 
If the block slicing for a preset range is not finished, the 

25 search range end decision unit 64 outputs a command signal 306 
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for causing the coordinate calculating unit 66 to issue the next 

block slicing-out coordinate. 

[0027] 

When fed with the end signal 305 from the search range end 
decision unit 64, the key information generator 65 is fed with 
the information 312 in the maximum inner product buffering unit 
68 to generate the key information in the maximum inner product 
buffering unit 68 to output the key information 202 to the cipher 
decoder 7. 
[0028] 

From the coordinates, by which the key information patterns 
have been inserted, the coordinate calculating unit 66 outputs 
coordinates 307, 308, shifted in +X, +Y, - X and -Y directions, 
respectively. The coordinate calculating unit 66 also outputs 
a number of coordinates 307, 308 with the number being equal to 
the number of the inserted key information patterns. 
[0029] 

Figs. 5, 6 and 7 are flowcharts showing the processing 
operations of the electronic watermark inserter, shown in Fig. 1, 
an electronic watermark detector, shown in Fig. 3, and the key 
detector 6, shown in F i g. 4, respectively. Referring to Figs. 1 
to 7, the method for inserting the electronic watermark and the 
method for detecting the electronic watermark, according to an 
embodiment of the present invention, are now explained. 
[0030] 
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The picture analyzer 3 analyzes an input picture 101 (or an 
image) to decide the insertion strength of the electronic 
watermark to be inserted, from one pixel of the input picture to 
the next, to output the insert ion strength information 104 to the 
5 electronic watermark pattern inserter 1 and to the key 
information pattern inserter 2 (step 1 in Fig. 5). 
[0031] 

The electronic watermark pattern inserter 1 inserts an 
electronic watermark pattern 105, stored in the electronic 

10 watermark pattern storage un i t 4, i nto the i nput p i cture 1 01, in 
accordance with the insertion strength information 104 from the 
p i cture ana I yzer 3, to output a p i cture to be processed 1 02, into 
which has been inserted the electronic watermark pattern or 
patterns, to the key information pattern inserter 2 (step S2 of 

15 Fig. 5). 
[0032] 

The key information pattern inserter 2 inserts a key 
information pattern 106, stored in the key information pattern 
storage unit 5, into the picture to be processed 102, into which 
20 the electronic watermark pattern has been inserted by the 
electronic watermark pattern inserter 1 (step S3 in Fig. 5), to 
output the processed picture 103, into which has been inserted 
the lay information pattern, to outside (step S4 in Fig. 5). 
[0033] 

25 The key detector 6 detects the key information of the input 
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picture 201, enlarged/contracted following insertion of the 
electronic watermark pattern, based on the key information 
pattern(s) i nserted i nto the i nput p i cture 201, to output the key 
information 202 and the input picture 201 to the cipher decoder 
7' In this case, the key detector 6 outputs the input picture 
201 straightforwardly to the cipher decoder 7 (step S11 of 
Fig. 6). 
[0034] 

That is, theblockslicer (sectioner) 61 in the key detector 
6 slices out (sections out) one block (section or pixel) of the 
input picture 201 with the coordinate 306 obtained from the 
coordinate calculating unit 66, to output the so-sliced out 
block to the inner product unit 52 (step S21 of Fig. 7). 
[0035] 

The inner product unit 62 finds the inner product of the 
sliced-out block 301 from the block slicer 61 and the key 
information pattern stored in the key information pattern 
storage unit 67 to output the result of the inner product 302 to 
the maximum inner product value detection unit 63 (step S22 of 
Fig. 7) . 
[0036] 

The maximum inner product value detection unit 63 compares 
the result of the inner product 302 from the inner product unit 
62 to the information 311 in the maximum inner product buffering 
unit 68 (step S23 in Fig. 7). If it is the result of the inner 
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product 302 that i s I arger (s t ep S24 o f F i g. 7) , the max i mum i nner 
product value detection unit 63 outputs the result of the inner 
product 302 and the coordinate 307 obtained from the coordinate 
calculating unit 66 (coordinate of the sliced-out block) as 
being the result of the inner product 303 to the search range end 
decision unit 64. The maximum inner product value detection 
unit 63 also substitutes the result of the inner product 304 for 
the correspondingvalue in themaximum inner product value in the 
maximum inner product buffering unit 68 (step S25 in Fig. 7). 
[0037] 

If the result of the inner product 302 is smaller (step 24 
in Fig. 7), the maximum inner product value detection unit 63 
outputs the result of the inner product 302 and the coordinate 
307 obtained from the coordinate calculating unit 66 (the 
coordinate of the sliced-out block) as being the result of 
decision 303 to the search range end decision unit 64. 
[0038] 

If the slicing out of the block of the preset range is not 
completed (s tep S26 of F i g. 7) , the search range end dec i s i on un 1 1 
64 outputs a command signal 306 for causing the coordinate 
calculating unit 66 to output the next block slicing-out 
coordinate (step S27 of F i g. 7) . 
[0039] 

When fed with an end signal 309, Indicating the end of 
slicing out of the block of the preset range from the coordinate 
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calculating unit 66 (step S26 of F i g. 7) , the search range end 
decision unit 64 outputs an end signal 305 to the key information 
generator 65 (step S28 of Fig. 7) . 
[0040] 

5 When fed from the end signal 305 from the search range end 

decision unit 64, the key information generator 65 is fed with 
the information 312 in the maximum inner product buffering unit 
68 to generate the key information from the coordinate in the 
maximum inner product buffering unit 68 (step S29 in Fig. 7) to 
10 output the key information 202 to the cipher decoder 7 (step S30 
in F i g. 7) . 
[0041] 

The cipher decoder 7 generates parameters required by the 
electronic watermark detector 8, based on the input picture 201 

15 and on the key information 202 from the key detector 6 to output 
the so-generated parameters 203 and the input picture 201 to the 
electronic watermark detector 8 (step S12 of Fig. 6). In this 
case, the cipher decoder 7 outputs the input picture 201 
straightforwardly to the electronic watermark detector 8. 

20 [0042] 

Based on the parameters 203, required for electronic 
watermark detection, generated by the cipher decoder 7, the 
electronic watermark detector 8 detects the electronic 
watermark pattern or patterns inserted into the input picture 
25 201 (step SI 3 of F ig. 6) to output the resu I t of detect i on 204 to 
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outs ide (step S14 of Fig. 6) . 
[0043] 

By inserting the electronic watermark pattern 105 to the 
input picture (or pictures) 101, and by then inserting into the 
5 P i cture or p i ctures the key i nf ormat i on pat terns 1 06, arrayed at 
a preset interval, and which when inserted are shifted in random 
directions, the electronic watermark positions are randomized, 
thus improving the secrecy of the inserted electronic water 
marking. 
10 [0044] 

Moreover, by detecting the key information pattern 
inserted with the electronic watermark pattern, generating the 
parameters necessary for detecting the electronic watermark 
pattern from the so-detected key information pattern and by 
15 detecting the electronic watermark based on the so-generated 
parameters, it is possible to improve the secrecy of the inserted 
electronic water marking data. 
[0045] 

By adding these processing operations to the former half 
20 and to the latter half of the electronic watermark inserter not 
coped with by (or not compatible with) thekeyinforraation, it is 
possible to improve the secrecy of the inserted electronic 
watermark data. 
[0046] 

25 The meritorious effects of the present invention 
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are summar i zed as foil ows. 

According to the electronic watermark inserter of the 
present invention, in which, in the electronic watermark 
inserter for inserting the electronic watermark pattern for 
specifying the furnisher of the picture or image to data of the 
picture or image, the key information pattern, prepared at the 
outset, is inserted into the picture or image, into which has 
been inserted the electronic watermark pattern(s), and the 
resulting picture or image is transmitted, it is possible to 
improve the secrecy of the inserted electronic watermark data. 
[0047] 

Moreover, according to the electronic watermark detector 
of the present invention, inwhich, in the electr on ic watermark 
detector for detecting the electronic watermark pattern (s) used 
for specifying the furnisher of the picture or image, Inserted 
i nto the p i cture or Image, the key i nf ormat i on pat tern, inserted 
into the data of the picture or image, along with the electronic 
watermark pattern, is detected, the parameters required in 
detecting the electronic watermark pattern from the detected key 
information are generated, and the electronic watermark 
patterns are detected from the picture or image based on the 
so-generated parameters, it is possible to improve the secrecy 
of the inserted electronic watermark data. 

It should be noted that other objects, features and aspects 
of the present invention will become apparent in the entire 
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disclosure and that modifications may be donewithout departing 
the gist and scope of the present invention as disclosed herein 
and ciaimed as appended herewith. 

Also it should be noted that any combination of the 
5 disclosed and/or claimed elements, matters and/or it ems may fall 
under the modifications aforementioned. 



